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ABSTRACT 

The accuracy of predictions of future student 
performance on the basis of graphing , data on semi-logarithmic charts 
and equal interval graphs was examined. All 83 low-achieving students 
in grades 3 to 6 read randomly-selected lists of words from the 
Harris-Jacobson Word List for 1 minute. The number of words read 
correctly and words read incorrectly were scored. Story starters were 
used to obtain weekly 3-minute writing samples from the 83 students. 
The compositions were scored for total words written, words written 
correctly and incorrectly, and correct letter sequences written. 
Predictions made for the students on the basis of the reading and 
written expression data collected over 7 weeks were compared to 
actual data collected for weeks 8, 9, and 10. Analyses of deviations 
between predictions and actual scores indicated that predictions were 
more accurate when the data had been graphed on equal interval 
graphs. (Author/PN) 
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Abstract ^ 
The accuracy of predictions of future student performance on the 
basis of graphing data on semi -logarithmic charts and equal interval 
graphs was examined. Predictions made for 83 students on the basis of 
reading and written expression data collected over sfeven weeks were 
compared to-actual data collected for weeks 8, 9, and 10. Analyses of 
deviations between predictions and actual scores indicated ^that 
predictions v/ere more accurate when the data had been graphed on equal 
interval graphs. Implications for training are discussed. 




Measuring Academic Progress of Students with Learning 
Difficulties: A Comparison of the Semi-Logarithmic Chart 
..and Equal Interval Graph Paper 

Implementation of Public Law 94-142 requires that\an Individual 
Educational Plan (lEP) be written for all handicapped students 
receiving- special education services. In addition, the same 
legislation mandates the use, of fair and nondiscriminatory assessment 
practices in monitoring student progress toward lEP objectives. The 

r 

use of traditional achievement -and intelligence tests for such 
purposes, however, may be a tenuous exercise. Salvia and Ysseldyke 
(1981) warn that many test^ lack evidence of validity .or reliability. 
Jenkins and Pany (1978) .point out that achievement tests 
differentially sample student curricula and therefore provide 
educators' with questionable data about actual student performance. 
And finally, norm-refereiiced tests are not adequately designed to 
measure pupil progress (Carver, 1974; Hively '& Reynolds,. 1975). 

An alternative assessment strategy is the use of repeated 
measurement and time series analysis of the student's academic skills. 
This methodology has been outlined in several approaches to delivering 
"^special education services: Precision" Teaching (Lindsley, 1971), 
Exceptional Teaching (White & Haring, 1976), and Data-Based Program 
Modification (Deno & Mirkin, 1,977)"'. Common to all three models is the 
frequent measurement of student skills on various academic tasks 
related to lEP goals. The collected data typically are plotted on 
graph paper and the results subjected to a 'time series analysis. In 
this way, student progress toward lEP goals and the effectiveness of 
instructional strategies may be evaluated. 



I 

2 . 

While there are some similarities among these repeated 
measurement models, there is an important d'ifferencp involving the - 
type of graph to be used^ in charting student data. P^oponents of the 
^Precision Teaching and Exceptional Teaching models advocate che use of 
the Stancfard Behavior Chart (Pennypacker ^ Koenig, & Lindsley, 1972), a 
graph on which variables measured alor>g the ordinate (vertical axis) 
are recorded on a logarithmic scale. Those favoring this semi- 
logarithmic chart claim improvement in academic performance is 
proportional, not arithmetical, and is measured and* predicted -best on 
the logarithmic scale (Howell, Kaplan, & O'Connell, 1979). The 
implication for the exceptional student who initially may acquire 
academic skills at a slow rate is illustrated by White and Haring 
(1980).. These authors noted that graphing typical student performance 
data on an equal interval chart may be misleading since i;iitian.y 
progress is slow. Using the equal interval chart, a successful 
instructional plan might be abandoned because of lack of improvement^ 
whereas the same set of student data on the Standard Behavior Chart 
will appear more orderly in its display of growth. 

However, many proponents of time series analysis indicate that 
equal interval graphs ^erve educational needs just as well. Most 
graphing procedures used in major texts emphasizing time . series 
analysis in education employ equal" interval graphs (Glass, Willson, & 
^ Gottman, 1975; ^ Kratochwill, 1978; O'Leary & O'Leary, 1972; 
Sulzer-Aiaroff & -Mayer, 1977). The' dilemma facing practitioners is 
choosing the more technically adequate graphing procedure. 

Brandstetter and Merz (1978) addressed the issue of the efficacy 

ERIC 



of both graphing procedures. They found higher rates of student 
acMevement when data were charted on* the two types of graphs compared 
to not charting data. However, their research did not directly 
compare the semi-logarithmic chart with the equal interval graph. The 
question of which graph to use is not a trivial one. Test standards 
developed by the American Psychological Association, American 
Educatidnal Research Association, and the National Council for 
Educational Measurement (APA, 1972) require that scaling methods used 
in assessment pro^dures be technically adequate; "^Users of the 
Standard Behavior Chart and equal interval graph must attend to these 
recommendations for "they are^ integral to assessment procedures 

''I 

currently recommended fot exceptional students. 
• \ * * 

The research presented here compares the two approaches. Since 
proponents, of the Standard Behavior Chart maintain a significant 
characteristic of the semi-logarithmic chart is the ability to predict 

.student performance better, we have focused on an analysis of the 

1 

accuracy of the. different predictions generated by each type of chart. 

i 

Each^chart produces different predictions-.- -As— may be seen in Figure 

I 

1, the projections of student performance from the same set of data on 
the two, types of charts afe very d"^fferent. The research presented 
here examines efficacy of the linear model (equal interval graph) and 
'ithe logarithmic model (semj-logarithmic graph),. 



Insert Figure 1 about here 



' Method ' 
Design | 

Student performance on direct, repeated measures of reading and 

1 

written expression were collected we'.ekly over a 2 1/2 month period for 
83 low-achieving elementary students. Using a computer program to 
simulate charting on both equal interval and semi-logarithmic graphs, 
each .student's data were entered into "the^computer at the end of the 
seventh week. .Regression equations for each set of student data for 
both charts were calculated. The sljDpe of each student's performance 
on both the semi -logarithmic and equal ^'nterval chart then was used to 
predict student performance at weeks 8, 9, and 10 of the data 
collection^ period. The estimates of student performance at the^e" 
times were contrasted, with the' actual data collected at weeks 8, 9, 
and 10 by , determining the absolute deviation between Jthe scores. 

li^ size t)f the deviation scores for the semi-logarithmic chart 
(logarithmic model) was. thei^ compared to the magnitude of the 
deviations on the equal interval graph (equal interval model) for each 
Student on each measure with a paired t;-test analysis* On thos,e 
comparisons where significant differences were found, the graphing 
approach with the smaller average deviation score was considered to be 
the one .making better predictions of student performance* 
Subjects , • ' 

, Selection of this low-adhieving population resulted from the 
screening of all 785 elementary students from grades 3-6-enrolled in 
three elementary schools. The schools were located within communities 
in rural settings, ' yet each was within 50 miles of the metropolitan 



Twin City area. According to 1970 Census figures, the three 
communities ranged in size from 2^281 to 6,876* • ^ 

Screening procedures involved a , short c/uration measure of written 
expression tha£ significantly discriminated LD and non-LD students 
(Deno, .Marston,. & Mirkin, 1982) • .Each student was administered a 
Story starter .and asked to write a composition. For each student, the 
number of *words written in the composition (Total Words Written) was 
computed. Students who ha(^ no history of special .education services 
and scored at or below the iSth percentile were asked to participate 
in the repeated, direct measurement phase of the study. Cutoffs for 
the 15th percentile at each grade- level are shown irfTable 1. 
Parental permission was received for 83 students. Twenty-si5;«c of the' 
students vyere third graders, 17 were fourth graders, 19^ were fifth 
graders, afid 21 were sixth graders. Thirty-two of the low-achieving 
population were females. The number of males^ and female's at each 
grade level is presented in Table 2. » ' 

Insert Tables 1 and 2 about, here 



Procedures v 

All 83 students were administered short duration measures 
designed for direct, repeated measurement of reading (Deno, Mirkin, & 
Chiang, 1982) ^and written expression (Deno, Marston, & Mirkin,, 1982) 
on a weekly basis ft)r 10 weeks. v , 

Reading . Lists of words that were selected randomly ^from'^the 
third grade level of the Harris-Jacobson Word tTst (Harris & Jacobson, 



1972) were used for tha heading' tasks; these 'were admin isterad each 

week. F^r eacR list, the student, was asked to read aloUd for, one. 

minute. T^st instructicrris read verbatim to the subject were: 

Here is a word list' that I .want you to "read. When I tell 
you to start, you can read across the page. *- Please read -as 
fast and accurately as you can. If you get stuck on any, of . 
. the words, move on; to the next one. I will tell you when 'to' 
stop reading. Are there any questions? Ready? Begin. 

■• . • » 

The child ther. v^^as timed for 60 seconds whilo the teacher followed 

along and recorded mistakes on a shedt identical to the one from"which 

the student read. If a student did not respond after approximateJ,y 

six seconds, he/she wa's told to move on to the next word. At tJ\e -end 

of the timing, recording sheets ,iere collected , and later scored by 

trained judges. For each list, the numbers of Words Read Correctly^, 

(WRC) and Words Read Incorrectly (WRI) were scored. Estimates of 

inter-rater agreement ranged, from .94 to .98. 

In addition to reading the third grad^ lists, ,the fourth, fifth, 

and' sixth graders were ask^d to read* a list of w'ords selected from 

their grade level from, the Harris-Jacobson list. For example, each 

week the fifth graders read'both a. third grade list and a fifth grade 

list. Tor~each of these lists, the number of Words Read Correctly 

from Grade Level (WRCG) and the number_^i„Wor-ds- Read TncdrrectTy^f rom 

Grade Level (WRIGjjiece-ctJuntedV " ' 

ntten expression . Story star-ters" were used to obtain weekly 

writing , Samples from the 83 students. Directions to the students 

were: 

I want you. to write a story. I am going to read a sentence 
to you first, and then I want you to write a short story 
about what happens* Yoju will have a minute to think* about a. 
story to write and then you will have three minutes to write 
it* when I say "please start writing" you may begin* 



students' responses to each story starter were scored by a trained 

judge. The compositions were scored for Total Words Written, Words 

Written Correctly, Words • Written Incorrectly, and Correct Letter 

Sequences Written (White & Haring, .198.0). Inter-rater agreement was 

• . * » 

.87. ■ . > -. ' • 

Results 

On all ^ test comparisons, the .05 leve\ of probability was used 
^as- the criteri^on level for significance. In the first analysis, the 
1 i near ( equa 1 i nter\Aa V) and 1 ogar i thmic model s were compared on 
predictions of student performance at week 8 based upon* the slope of 
the first seven weekly measilirements. f^s may be seen in. Table 3, only 
one of the contrasts w?is significant; the difference favored the 
linear model in measuring Words Written Incorrectly. 



\ Insert Table 3 about here 



Predicting week 9 performance from the slope of the first seven 
weeks was^ the focus of the 'second analysis. The results from ^his 
analysis are presented in Table* 4. Four of eight comparisons (Words 
Read Incorrectly, Total Words WritteOr Wor^ds^Written Incorrectly, and 
Correct Letter Sequences) were si5'n>f1cant; all differences favored 
the linear model , ^wh^^ch exhibited smaller 'devi*ations between predicted 
and actual scores. Two othep^ contrasts, which a1s^ displayed lower 
deviations for equaV interval graphs, -^approached significance (Words 
Read Correctly, £ - .054; Words* Read Incorrectly on "^rade Level 
Material, .069). ' i * V ^ * ' ^ 



8 



Insert Table 4 about here 
J. ^. 



Week 10 estimates based upon the seven-week slope were examined 
in the t>iird analysis. As can be seen in Table 5, four of the eight 
contrasts were significant at the .05 level; again, these favored the 
linear mode'T. The comparison for Words Read\ncorrectly on Grade 
\Level Material approached significance (£ = .05^), with smaller 
deviations demonstrated on equal interval graphs. 



Insert Table 5 about here 



In the final analysis, the deviation scores for weeks 8, 9, and 
10 were summed for each student ancf then averaged for each .graphing 
approach (see Jable 6). Again, predictions tfiade by the linear model 
were significantly more accurate in four of eight cases, with a fifth 
contrast approaching' significance. 



Insert Table 6 about here 



♦ Discussion - ' 

The research described here focused on only G5ne aspect of 
graphing, the use of time series data to predict future performance. 
Yet, this in itself is quite significant when the writing of lEP goals, 
is considered. White and hiaring (1980) proposed that an analysis of 
the slope of student data is useful in producing goals and objectives. 



Thus, generating predictions from time series data is helpful in the 
delivery of special services to the exceptional student. The question 
asked here is, which graph should be used in charting student 
performance? 

Our research indicates * that predictions of student performance 
for weeks 8, 9, and 10, based on seven we^s of data in reading and 
Written expression, are more accurate when data are graphed on the 
equal interval chart. In no cases did comparisons showing a 
significant difference favor the Standard Behavior Chart. 

The most important implication of this research is for ^training. 
It has been our personal experience that educators resist using the 
Standard Behavior Chart for reasons ranging from "it's overly complex" 
to "it's difficult to understand." In many instances, those 
discouraged by the semi-logarithmic graph but interested in graphing 
are more willing to use equal interval graphs. If increasing the 
likelihood that special educators will use repeated measurement 
strategies in their educational planning, interventions, and 
assessments is a function of the type of graph they prefer (usually 
the equal interval chart), we believe the research presented here 
provides an empirical basis for making that choice. 
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Table 1 

Screening Criteria for Measure of Written Expression 







Sampi e 




Cutoff for 


Grade 


• -Size 


Mean 


15th Percentile 


3 


190 


■ '17.7 


9 










4 


185 


'22.7 


12 


, 5 


225 


30.5 


19 


6 


185 


36.4 


24 



Table 2 

Distribution of Sexes by Grade Level 



Grade 


Male 


Female 


3' - ■ 


... _ 


.,-2 


4 


10 


, 7 


5 


14 


5 


6 


■ 13 ' 





Table 3 

Comparison of Linear and Logarithmic Models in Predicting Performance at Week '8 



Sample Type of J^ean Standard 

Size Graph Deviation Deviation 



T-value Probabilis^y 



Reading Measures 



Words Read Correctly 
3rd Grade Level 


75 


EQ, Interval 
Log 


9.55 
9.84 


• Z.6 
8.3 


1.67 


Words Read. Incorrectly 
3rd Grade Level 


75 


EQ Interval 
Log 


2.87 
3.24 


* 

1 .1 
3.8 


.83 


Words Read Correctly 
Grade Level 


55 


EQ Interval 
Log 


5.99 
5.97 


4.7 
4.6 


.29 


Words Read Incorrectly 
Grade Level 


54 


EQ Interval 
Log 


2.77 
3.12 


2.6 
3.1 


1 .62 



' Wri;tten Expression Measures 
Total Words Written 75 

Words Written Correctly 75 

Words- Written Incorrectly 75 

Correct Letter Sequences 75 
for Writing Ta^k 



.100 
.409 



.772 



.111 



EQ Interval 


6.90 


5.2 


1 .35 


.183 


Log 


7>.17 


5.7 






EQ interval 


6.49 


5.3 


1 .20 


.232 


Log 


7.05 


6.6 






EQ Interval 


1 .81 


1 .5 


2.45 


.016 


Log 


2.42 


2.7 






EQ Interval 


28.38 


21 .3 


1.60 


.115 


Log 


29.89 


23.8 
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Table -4- 

Comparison of Linear and Logarithmic Models in Predicting Performance at Week 0 





Sainpl e 
Size 


«> 

Group 


Mean 

Deviation 


Standard 
Deviation 


T-value 


Probabil ity 


-Reading- Measures 




> 








_ — 

I* 


Words Read Correctly 
*3rd Grade Level 


76 


EQ Interval 
Log 


9.69 
10.15 


9.0 
10.2 


1 .96 


.054 


Words Read Incorrectly 
3rd Grade level 


76 


EQ Interval 
Log 


2.81 
G.36 


1 .3 
8.9 


2.52 


.014 


Words Read Correctly 
Grade Level 


•54 ' 


EQ Interval 
Log 


7.30 
7.13 


7.3 
6.9 


1.25 


.217 


^ords Read Incorrectly 
Gracle^L^el 


54 


EQ Interval 
Log 


3.14 
3.90 


2.9 

4.7 , 


1 .86 ■ 


.069 


Wr'i'tten Express^orf^Mea^sures 












Total Words Written 


78^^^^^ 


-~-EQ.J[nterva1 
Log^ - _ 


8.62 

1_ 9., 4 5 


7.0 
8.2 


.2.58 


.012 


Words Written Correctly 


78 


EQ Interval 
Log 


872 3 - - 
9.85 


i2.r~~--- 


1 .58 


.119 


Words Written Incorrectly 78, 

i 


EQ Interval 
Log 


1 .94 
3.19 ^ 


1.9 
5.7 


2.04 


-r045_^ 


Correct Letter Sequences 
For Writing Task 


78 


EQ Interval 
-Log 


36.12 
40.51 


30.1 
35.2 


2.95 


.004 
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Table 5 ^ 

Comparison of Linear and Logarithmic Models in Predicting Performance at Week 10 



Sample Type of Mean Standard, 

Size Graph Deviation Deviation T-value , Probability 



Reading Measures 



Words Read Correctly 


79 


Interval 


13.56 


9.8 


1 


.64 


.105 


3rd Grade Level 




Log 


14.05 


10.6 








Words Read Incorrectly* 


79 


EQ Interval 


3.43 


1 .3 


2 


.12 


.037 


3rd Grade Level 




Log.' 


8.50 


21 .3 








Words Read Correctly 


54 


EQ Interval 


10.11 


9.5 


1 


67 


.101 


Grade Level 




Log 


9.82 


9.2 








Words. Read Incorrectly 


54 


EQ Interval 


■ 4.37 


5.1 


1 


.96 


.056 


Grade Level 




Log 


'5.. 80 


7.7 








Written Expression Measures 














Total Words Written 


79 


EQ Interval 


• 9.87 


8.6 


2 


.95 


.004 






Log 


11 .29 


9.2 








Words Written Correctly 


79 


EQ Interval 


9.31 


8.3 


1 


.44 


.1,53 






Log 


12.53 


21 .4 








Words Written Incorrectly 


79 " 


EQ Interval 


1.75 


1.6 


2 


.21 


.030 




' Log- 


3.26 


6.2 








Correct Letter Sequences 


79 


EQ Interval 


43.03 


34:6 


2 


.19 


.032 


for Writing Task 




Lbg , 


48.27 


• 40.9 
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■ .. Table 6 ' 

Comparison' of Linear and Logarithmic Models in Predicting Performance at Weeks 8, 9, and 1.0 





Sample 
Size 


Type of 
Graph 


Mean 

Deviation 


Standard 

Deviation T-value Probability 



Reading Measures 



Words Read Correctly 
3rd Grade Level « 


72 


EQ Interval 
Log 


10.90 
11.24 


7.8 
.3.7 


1 .51 


.136 




Words Read Incorrectly 
' 3rd Grade level 


72 


EQ Interval 

' 1 on 


2,89 
4 92 


2.2 

8 8 


1 .99 


.050 




Words Read Correctly 
' Grade Level 


51 ^' 


EQ Interval 

Log" 


-.--7j;?74 
7^60 


5.7 
5.3 


1.17 


.248 




-Words-Read^ Tncorrectly 
Grade Level 




EQ Interval 
Log 


' "3733"" 
4.19 


3.0 
' 4.8 


'1 .78 


.081" 




^< 

Written Expression Measures 














Total Words Written 


72- 


EQ Interval 
Log 


8.67 
9.54 


5.1 
6.1 


2.59 


.012 




Words Written Correctly 


72 


EQ Interval 
Log 


8.17 
10.06 


5.3 
12.7 ' 


1 .41 
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EQUAL IiiTERVAL GRAPH: Linear Model (10-week nrediction = 4?^ words) 
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Figure 1, Projections of Student Performance losing Two Types" of Charts 
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